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ABSTRACT 

■ We demonstrate that decay angle correlations in t~t + and it decay modes could 

allow a determination of whether or not a neutral Higgs boson is a CP eigenstate. 
Sensitivity of the correlations is illustrated in the case of the e + e~ — > ZH 
J> | and fi + fi~ — > H production processes for a two-doublet Higgs model with CP- 

violating neutral sector. A very useful technique for minimizing 'depolarization' 
factor suppressions of the correlations in the it mode is introduced. 
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Determination of the CP nature of any neutral Higgs boson that is directly ob- 
served will be crucial to fully unraveling the nature of the Higgs sector. It is entirely 
possible to have either explicit or spontaneous CP violation in the neutral Higgs sec- 
tor. Indeed, the simplest non-supersymmetric two-Higgs-doublet model (2HDM) and 
the supersymmetric Higgs two-doublet plus singlet model both allow for Higgs mass 
eigenstates of impure CP natureB. Here we shall focus on the 2HDM, in which CP 
violation results in three neutral states, #1=1,2,3, of mixed CP character. 

The most direct probe of CP violation is provided by comparing the Higgs bo- 
son production rate in collisions of two back-scattered-laser-beam photons of various 
different polarizations!. A certain difference in rates for different photon helicity 
choices is non-zero only if CP violation is present, and has a good chance of being of 
measurable size for many 2HDM parameter choices. 

Correlations between decay products can also probe the CP nature of a Higgs 
boson. In this paper we focus on effects that arise entirely at tree-level. For the 
dominant two-body decays of a Higgs boson, one can define appropriate observables if 
we are able to determine the rest frame of the Higgs boson and if the secondary decays 
of the primary final state particles allow an analysis of their spin or helicity directions. 
An obvious example is to employ correlations between the decay planes of the decay 
products of WW or ZZ vector boson pairs and/or energy correlations among the 
decay product JffliiS. However, these will not be useful for a purely CP-odd H 
(which has zero tree-level WW, ZZ coupling and thus decays primarily to FF) or for 
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a mixed-CP H in the (most probable) case where the CP-even component accounts 
for essentially all of the WW, ZZ coupling strength (thereby yielding 'apparently CP- 
even' correlations). In contrast, H decays to t~t + or tt, followed by r or t decays, 
do, in principle, allow equal sensitivity to the CP-even and CP-odd components of a 
given Higgs boson. 

Indeed, a H eigenstate couples to FF according to: C oc F(a + ibj 5 ) FH , which 
yields 

(F + F + \H) oc b + ia(3 F ; (FJF-\H) oc b - ia(3 F , (1) 

where j3p = \A ~ ^m 2 F /m 2 H , helicity-flip amplitudes being zero. The crucial point is 
that, in general, a and b are of comparable magnitude in a CP-violating 2HDM. 

Here, we shall present a unified treatment aimed at realistically evaluating the 
possibility of using correlations in H — > t~t + and tt final states to determine if 
a decaying Higgs boson is a mixed CP eigenstate, thereby directly probing for the 
presence of CP violation in the Higgs sector. 

An efficient framework for our analysis is that developed in Refs. Consider 
the charged current decay F — > Rf, where F is a heavy fermion, / is a light fermion 
whose mass can be neglected, and R can be either a single particle or a multiparticle 
state with known quantum numbers and, therefore, calculable coupling to the charged 
weak current. (Examples are r — > Rv, where R = tt, p, Ai, . . ., and t — > Wb, where W 
decays to a fermion plus anti- fermion.) For the i?'s of interest, the form of the hadronic 
current J M , deriving from the standard V — A interaction for the J M = (R\V^ — A^\0) 
coupling, is completely determined in terms of the final particle momenta. Using the 
particle symbol to denote also its momentum, and defining 

n M = 4Re JJ ■ J* - 2f^J ■ J*, Ul = 2e, pu Jm J?J* »r, (2) 

all useful correlations in H — > FF decay can be obtained by employing the quantities 

u = f ■ (n - n 5 ), r p = m 2 F (u - n 5 )^ - f^f ■ (n - n 5 ) , (3) 

and their F analogues. In the F rest frame, Rq = 0, R = m F (U— n 5 ), and \R\ = mpio. 
In fact, Sf = R/{mpuS) acts as an effective spin direction (|>Sf| 2 = 1) when in the F 
rest frame. 

Let us give some illustrative examples. For t~ — > ix~v decay, J M oc tt~ and 
S T - = 7T~ is the unit vector pointing in the direction of the 7r~'s three momentum 
(using angles defined in the r~ rest frame). For t~ — ► p~v — > ir~7T°b>, oc (it~ —it )^, 
yielding n M oc 4(7r~ — 7T°) M z/- (tt~ — 7r°) + 2z/ M m 2 , and, thence, Sp oc m T (7r~ — 7i°)(E n - — 
E n o) + um 2 p /2 , where the pion energies and directions are defined in the r~ rest 
frame. For t — > W + b — > l + ub, J M oc u{y)^^{l — r y 5 )v(l + ), and oc l+v ■ b + u^l + ■ b, 

oc z/^/ + • b — l+v ■ b, so that — oc i+ implying S t = l + in the t rest frame. 

If the full (n — n 5 )^ can be determined on an event-by-event basis, then we can 
define the 'effective spin' vectors Sp and S F for each event, and the distribution of 



the Higgs decay products takes the very general form 



dN oc 



{b 2 + a 2 (3 2 F ){\ + cos 9 cos 9) + (b 2 - a 2 (3 2 F ) sin 9 sin 9 cos(0 - 0) 
—2ab(5p sin 9 sin 9 sin(0 — 0) d cos 9d cos 9d<pd<f) , (4) 



where and define the angles of Sf and S"^ in the F and F rest frames, 
respectively, employing the direction of F in the H rest frame as the coordinate- 
system- defining z axis. 

If we cannot determine (II — II 5 ) /t for each event, then Eq. f| must be modi- 
fied. An extreme example is F — > Rf decay where the R decay products are not 
examined. In this case the angles of R in the F rest frame would be employed in 
Eq. [I], and 'depolarization' factors arise as a result of event averaging. In deriving 
Eq. ||, the angular independent term is actually multiplied by {m F oj F ){m F u> F : ) and 
the cos 9 cos 9, sin 9 sin 9 sin(0 — 0) and sin 9 sin 9 cos(0 — 0) terms by \Rf\ \R~f\- ® n 
an event-by-event basis the ratio of these coefficients is unity, as outlined earlier. 
When averaged over events, this is no longer true. Consequently, when event averag- 
ing (denoted by (...)) all the angle-dependent terms in Eq. £| must be multiplied by 
D F = (\R F \) / (m F (u F )) and/or its D F analogue, relative to the angle-independent 
term. We define D = D F D-p. 

At first sight, the necessity of event averaging arises in the case of the tt final 
state, for which we will find that we must have one top decay leptonically and the 
other hadronically in order to define the tt line of flight and, thereby, appropriate 
angles in Eq. f|. For the hadronically decaying top, the problem is to distinguish the 
quark vs. anti-quark jet coming from the W so as to construct (IT — II 5 ) M (which is 
proportional to the W + iW~) anti-quark (quark) momentum for t (t) decay) for each 
event. If we simply sum over all W decay product configurations, then the appropriate 
depolarization factor is easily computed by using J M oc ejf and summing over W 
polarizations. One finds D t = (m 2 — 2m 2 v )/{m 2 + Irn 2 ^) ~ 0.4 for m t = 174 GeV. 
Similarly, for r — > Rv where R is spin-1. 

Let us now specify our procedure for isolating the coefficients of the cos(0 — 0) 
and sin(0 — 0) angular correlation terms. Defining c = cos#, c = cos#, s = sin#, 
s = sin 9, Cff, = cos 50, = sin 50 (where <50 = — 0), and dVL = dcdcd5(j), and 
including a possible depolarization factor, we have 

1 dN 1 . 

— [1 + DCC + piSSScj, + p2SSC ( j > \ , (5) 



N dQ 8vr 

where 



_ 2abp F _ n (fe 2 -a 2 /^ 

Pl = D (V + a*ft)' P2 = D W^W)- (6) 

For a CP-conserving Higgs sector, either a = or b = implying p\ = and 
\p2\ = D. For a CP-mixed eigenstate, both a and b are non-zero. Thus p\ ^ 



provides an unequivocable signature for CP violation in the Higgs sector, while the 
difference D — \p 2 \ also provides a measure of Higgs sector CP violation. (Indeed, p\ 
and P2 are not independent; p\ + p\ = D 2 .) Values of p\ ~ D and p 2 ~ are common 
in an unconstrained 2HDM. 

To isolate pi and p 2 , we define projection functions f 1,2(6, 9, 5(f)) such that / fi^dfl = 
0, / fi^ccdft = 0, / fisss^dQ = 8n, J fissc^dfl = 0, / f^ss^dft = 0, and / f 2 ssc l f > dQ = 
8n. Then, pi j2 = / fi^jq^dVt. The critical question is with what accuracy can p 12 
be determined experimentally? The error is minimized by using projection func- 
tions which match the angular dependence of the term of interest. Thus, we em- 
ploy fi = (9/2)sss0 and f'2 = (9/2)ssc^, for which yi t2 = 9/2 and pip/Spip = 
2^ Pl , 2 VN/[l-(2/9)pU^. 



We now discuss the Higgs production reactions and the r _ r + and it final state 
decay modes for which the angles of Eq. f|can be experimentally determined. Consider 
first the t~t + case. The r decays are of two basic types: r — > Ivv and r — > i?z/, where 
i? is a hadronically decaying resonance of known quantum numbers. Together these 
constitute about 95% of the r decays, with BR{t — > Y*Rv) ~ 58.8%. Thus, we employ 
D = 1 and an effective branching ratio for useful r~r + final states of (0.588) 2 . 

In the case of it decays, we employ only the case where one top decays hadronically, 
and the other leptonically, such that we are simultaneously able to determine the exact 
it decay axis and distinguish t from i. Thus, we adopt an effective branching ratio 
for useful it final states of 2 x (2/3) x (2/9) (keeping only / = e,p). Employing one 
hadronic t (or i) decay and identifying the most energetic jet from the W + [W~) 
with the anti-quark (quark) leads to a depolarization factor of D ~ 0.78. 

In order to assess our ability to experimentally measure p% and p 2 , we have exam- 
ined H production in the reactions e + e~ — > ZH at a future linear e + e~ collider and 
p + p~ — > H at a possible future p + p~ collideiS. 

For the e + e~ collider we have adopted the optimal energy, y/s = m z + V2m H , 
and assumed an integrated luminosity of 85 fb _1 . For the p + p~ collider we have 
computed the Higgs signal and the continuum r~r + and it backgrounds assuming 
unpolarized beams and a machine energy resolution of 0.1%, with y/s centered at the 
value of rriH- 

For ran values such that the e + e _ — > ZH production mode is background free, the 
statistical significance of a non-zero result for pi is that given earlier, Ng D = \pi\/5pi, 
where 5p\ = (9/2 — p\ y^/y/N, and iV is the number of events after including the 
branching ratios required to achieve the final state of interest: BR e ff = BR(H — > 
FF) x BR(FF — > X), where the latter FF branching ratios to useful final X states 
were specified above. In the case of p 2 we must actually determine the statistical 
significance associated with a measurement of D — \p 2 \. This is given by Ng D = 
[D - \p2WSp2, where 5p 2 = (9/2 - pl) l ' 2 /^N. 

In p 4 p~ — ► H, the continuum backgrounds must be included. The statistical 
significance of a non-zero value for p\ is given by Ng D = \pi\/5p\ with 8p\ = [9/2 — 



Figure 1: The maximum statistical significances Ng D and Ng D for H — ► r r + (— 
-) and H —> tt (— — - -), in e+e" ZH (L = 85 fb" 1 ) and //+//~ -> # 
(L = 20 fb" 1 ) production, after searching over all a± and 03 values at fixed m# and 
tan/?. In each case, curves for the three tan/? values of 0.5, 2, and 20 are shown. In 
the r~r + (tt) mode Nsd values increase (decrease) with increasing tan/3, except in 
the case of p + p~ — > H — > tt, where the lowest curve is for tan/5 = 0.5, the highest 
curve is for tan/? = 2, and the middle curve is for tan/3 = 20. 

p\ +(B / S)(9/2+pf)] 1 / 2 / y/S, where S is the total number of events from H production, 
and B is the total number of events from the continuum background, in the final state 
of interest. For p 2 we have N% D = [D - \p 2 \]/5p 2 with 5p 2 = [9/2 - p\ + (B/S)(9/2 + 
p\ — 2p 2 p 2 )] 1 l 2 /\fS, where p 2 is that for the background alone. 

Our results for the maximum Ng D and Ng D values are presented in Fig.l, where 
we have adopted a top quark mass of 174 GeV. The maximum values were found 
by searching (holding tan (3 and m# fixed) over all values of the Higgs sector mixing 
angles at\ and 0:3, (for the notation see Ref. El). 

Consider first the results for e + e~ — > ZH collisions. From Fig. 1 we find that 
detection of CP violation through both p\ and p 2 is very likely to be possible for 
mil < 2m\y via the H — » t - t + decay mode. This is an important result given that 
various theoretical prejudices suggest that the lightest Higgs boson is quite likely to 
be found in this mass range. For m# between 2mw and 2m t , a statistically significant 
measurement of CP violation will be difficult. For ran > 2m t , detecting CP violation 
in the tt mode would require a somewhat larger L (of order 5 times the assumed 
luminosity of L = 85 ftT 1 for tan/3 between 2 and 5). 

In p, + p~ — > H production, Fig. 1 shows that the maximum Ng D and N$ D values 
in the r~r + mode can remain large out to large Higgs masses if tan/3 is large, but 
that for small to moderate tan/3 values the statistical significances are better in 
e + e _ — ► ZH collisions when m# < 2mw However, Fig. 1 also indicates that the 
— > H — ► r _ r + channel has the advantage of possibly small sensitivity to the 
WW decay threshold at niu ~ 2mw- Such insensitivity arises when the Euler angles 
0:1,0:3 are chosen so as to minimize WW,ZZ couplings (and hence H — > WW,ZZ 
branching ratios) without sacrificing production rate. Thus, for L = 20 fb" 1 p + p~ 
collisions could allow detection of CP violation all the way out to 2m t for tan f3 X 10. 
The tt final state extends the range of m# for which detection of CP violation might 
be possible only somewhat, and only if tan/3 lies in the moderate range near 2. 
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